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FINAL ACTION 

1. This action is responsive to communications: Amendment, filed on 10/01/2004. This action has 
been made final. 

Claims 1-26 are presented for examination. In amendment A, filed on 10/01/2004: 
Claims 1-26 are presented for examination. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragr^hs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this OflBce action: 

A person shall be entitied to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

5. Claims 1-10, 12-13, 15, 20-26 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Nelson et al. (hereinafter Nelson), US 4,598,397. 

6. As per claim 1, Nelson teaches a synchronization system for time-based synchronization of 
streaming media transmitted over a communications network, comprising: 

an input interface (wherein the interface is Fig 2, item 1 1) adapted for linking to the communications 
network to receive a first and a second media stream (see for example. Col. 5, lines 12-15, wherein the 
first media stream is asynchronous character oriented data, and second media stream is the synchronous 
terminal data), wherein the first and second media streams comprise a plurality of digital data packets 
being transmitted over the communications network from a first and a second media source (see for 
example. Col. 6, lines 55-67, wherein the sources comprises of plurality of clear channel devices and 
CODEC'S), respectively (CoL 5, lines 12-15, lines 26-28, lines 31-35); 

a first data buffer for storing the data packets of the first media stream (see for example. Fig 10(d) 
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item 3 12, wherein the bufifer is storing information about the synchronous information); 

a second data buffer for storing the data packets of the second media stream (see for example. Fig 
10(d), item 320, wherein the buffer is storing asynchronous information); and 

a controller (see for example. Fig 10(d), item 322) communicatively linked to the first and the second 
data buffers for selectively retrieving the data packets of the first and second media streams to form a first 
and a second time-adjusted stream (wherein the retrieving is done selectively depending on the mode of 
the system, i.e. synchronous or asynchronous, and judging from the clock signals going into items, 320 
and 3 16, the original stream is adjusted in accordance with output of item 342, thus the time adjusted 
stream is realized. Col. 19, lines 15-20, Col. 20, lines 5-35; Col. 9, lines 66-67; Col. 10, lines 1-3, lines 
12-13, lines 23-24), 

wherein the controller determines a variable transmission delay (Col. 9, lines 24-26, Col. 13, Unes 60- 
65, wherein the data is delayed prior to arriving at destination to allow proper synchronization. 
Furthermore, the controller 322 would determine the delay necessary, i.e. time in which the streams will 
be send out to the Multiplexsor and retrieve data from the buffers based on such a delay, this is because 
Nelson's invention is to combine different streams of data, see for example. Col. 25, Unes 40-50) for the 
first and the second media streams and performs the selective retrieving based on the determined variable 
transmission delays (Col. 13, lines 60-64; Col. 10, line 67-Col. 11, line 10); 

wherein the controller is further configured for combining the first and second time-adjusted streams 
into a composite media stream (wherein the composite stream is realized through the Multiplexor item 
3 1 8 on Fig 10, wherein the synchronous data and asynchronous data is combined into a stream; Col. 5, 
lines 12-15). 

7. As per claim 2, Nelson teaches the system of claim 1, wherein the first and the second media 
streams include a streaming video portion (Col. 6, lines 57-58). 
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8. As per claim 3, Nelson teaches the system of claim 2, wherein the streaming video portion of the 
first media stream is compressed based on a first compression format and the second media stream is 
compressed based on a second compression format, the second compression format differing firom the 
first compression format (Col. 5, lines 7-15, lines 26-28). 

9. As per claim 4, Nelson teaches the system of claim 3, fixrther including a decoding device 
between the input interfece and the first and second data buffers for processing compressed first and 
second media streams into a first decoded stream and a second decoded stream, respectively, for storage 
in the first data buffer and the second data buffer, wherein the first decoded stream and the second 
decoded stream have compatible formatting (Col. 6, lines 58-63; Col 7, lines 40-42). 

10. As per claim 5, Nelson teaches the system of claim 1, wherein the controller forms the composite 
media stream by combining the first and the second time-adjusted streams such that the second time- 
adjusted stream has a first data packet positioned at a start time adjacent a last data packet of the first 
time-adjusted stream positioned at an end time (Col. 9, lines 50-52). 

11. As per claim 6, Nelson teaches the system of claim 5, wherein the controller is communicatively 
Unked to an external timing reference for receiving a reference time value, and wherein the controller is 
adapted for using the reference time value to determine the start time and the end time (Col. 10, lines 1-3, 
lines 12-13, lines 23-24). 

12. As per claim 7, Nelson teaches the system of claim 5, wherein the controller determines a length 
of the first media stream (Col. 12, lines 26-29), compares the length with the end time and the variable 
network delay, computes an edit length for the first media stream, and compresses or lengthens the first 
media stream to form the first time-adjusted stream, whereby the last data packet coincides with the end 
time (Col. 13, lines 60-63; Col. 10, lines 12-13, lines 27-39, lines 67-68; Col. 11, lines 1-10). 


Application/Control Number: 09/742,165 
Art Unit: 2152 


Page 5 


13. As per claim 8, Nelson teaches the system of claim 1, further including a data parsing device in 
communication with the input interfece configured for retrieving time data fi-om the first and the second 
media streams and for transmitting the time data to the controller, wherein the controller uses the time 
data to determine variable transmission delays (Col 10, Hues 27-39; Col. 10, line 67-Col. 1 1, line 10). 

14. As per claim 9, Nelson teaches the system of claim 7, wherein the controller is adapted to create 
media server control signals based on the determined variable transmission delays and to transmit the 
signals over the communications network to the first and the second media sources to control 
transmission variables of the first and second media streams (Col. 7, lines 4-13). 

15. As per claim 10, Nelson teaches the system of claim 9, wherein the transmission variables are 
selected fi^om the group consisting of transmission timing, transmission rate, and transmission length 
(Col. 12, lines 26-29; Col. 10, lines 23-24, lines 28-39). 

16. As per claim 12, Nelson teaches the system of claim 1, wherein the controller combines the first 
media stream and second media stream in the composite media stream such that a data packet transmitted 
in the first media stream fi-om the first media source at a transmission time is matched with a 
corresponding data packet in the second media stream transmitted fi'om the second media source at the 
transmission time (Col. 5, lines 12-15; Col. 6, lines 59-63; Col. 10, lines 27-39). 

17. As per claim 13, Nelson teaches the system of claim 12, wherein the combining is performed by 
the controller by selecting a transmission rate for the first and the second media streams to correct for the 
determined variable transmission delays (Col. 10, line 67-Col. 1 1, line 10; Col. 10, lines 27-39). 

18. As per claim 14, Nelson teaches the system of claim 1, fiirther including an output interfece for 
transmitting the composite media stream fi^om the controller over the communications network and 
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including an end-user node linked to the communications network for receiving the composite media 
stream (Col. 5, lines 12-15; Col. 5, lines 49-54), wherein the end user node comprises a synchronizer for 
determining a variable transmission delay between the controller and the end user node and for 
performing time based correction of the composite media stream to adjust for the variable transmission 
delay (see for example. Col. 14, lines 45-48). 

19. As per claim 15, Nelson teaches an apparatus for synchronizing media streams transmitted over a 
communication network, comprising: 

an input interfece linked to the communications network and configured for receiving a first and a 
second media stream transmitted by a first and a second media source, respectively, wherein the first 
media stream comprises a plurality of data packets encoded to a first compression standard and the second 
media stream comprises a plurality of data packets encoded to a second compression standard differing 
from the first compression standard (Col. 5, lines 12-15, lines 25-27); 

a decoder for decoding the first and the second media streams into a first and a second intermediate 
media stream, respectively, wherein the first and second intermediate streams are compatibly formatted 
(Col. 6, lines 58-63); and 

a streaming media processor for combining the first and the second intermediate format media 
streams into a composite media stream encoded according to an output compression standard (Col. 5, 
Unes 12-15, lines 25-27; Col. 6, lines 58-63). 

20. As per claim 20, Claim 20 is rejected for the same reasons as rejection to claim 1 above. 

21. As per claim 2 1 , Nelson teaches the method of claim 20, fiirther including: 
retrieving timing data from the first and second media stream (Col. 5, lines 49-54); 

comparing the timing data vwth a reference time to determine a first and a second transmission delay 
value (Col. 10, lines 1-3, lines 12-13, lines 23-24); and 
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adjusting the first and the second media streams to correct for the first and the second transmission 
delay values (Col. 10, lines 27-39; Col. 10, line 67-CoL 1 1, line 10). 

22. As per claim 22, Nelson teaches the method of claim 2 1, wherein the adjusting includes creating a 
first and a second control signal in response to the first and the second transmission delay values, 
respectively, and includes transmitting the first and the second control signals to the first and the second 
media source to control transmittal of the first and the second media streams (Col. 7, lines 5-13; Col. 12, 
lines 26-29). 

23. As per claim 23, Nelson teaches the method of claim 21, storing the data packets of the first 
media stream in a first data buffer and the data packets of the second media stream in a second data buffer 
(Col. 9, Unes 62-63), and wherein the adjusting includes selectively retrieving the data packets of the first 
media stream fi-om the first data buffer to correct for the fu'st transmission delay value and selectively 
retrieving the data packets of the second media stream fi"om the second butter to correct for the second 
transmission delay value (Col. 13, lines 60-64; Col. 10, line 67-Col. 1 1, line 10). 

24. As per claim 24, Nelson teaches the method of claim 21, wherein the adjusting includes matching 
the data packets of the first and the second media streams based on transmittal times fi-om the first and the 
second media sources, respectively, whereby the first and the second media streams are presented in the 
synchronized media stream concurrently (Col. 5, hues 12-15; Col. 6, lines 59-63; Col. 10, lines 27-39). 

25. As per claims 25 and 26, Claims 25 and 26 are rejected for the same reasons as rejections to claim 
3 above. 

Claim Rejections - 35 USC § 103 

26. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
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rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior ait are such 
that the subject matter as a whole would have been obvious at the time the invention was made to a person having 
ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in 
which the invention was made. 

27. Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nelson et al. 
(hereinafter Nelson) 4,598,397, in view of Applicant Admitted Prior Art (AAPA), further in view of 
"FIRST GENERATION OF TRUE HDTV COMPONENT PRODUCTS AND ADVANCED LINE OF 
ANALOG PROJECTION TELEVISIONS UNVEILED BY MTTUBUSHI CONSUMER 
ELECTRONICS AMERICA", Mitsubishi, 1999. 

28. As per claim 1 1, Nelson does not explicitly teach the system of claim 1, wherein the composite 
media stream comprises a streaming video portion having picture-in-picture or side by side portions 
formed with the data packets of the first and the second time-adjusted streams. 

29. AAPA teaches the system of claim 1, wherein the composite media stream comprises a streaming 
video portion having picture-in-picture or side by side portions formed with the data packets of the first 
and the second time-adjusted streams (pg 3, lines 21-24), for the advantage of multiple synchronized 
display options for the user, the specification mentions "user demand" such synchronization techniques. 
This advantage is further exemplified by Mitsubishi, see for example, page 2, "multiple picture system", 
wherein there exist plurality of display options for users. 

30. It would have been obvious to one of ordinary skill in this art at the time of invention was made 
to combine the teaching of AAPA, Mitsubishi and Nelson because they both dealing with combining 
streams into a composite stream. Furthermore, the teaching of AAPA to allow wherein the composite 
media stream comprises a streaming video portion having picture-in-picture or side by side portions 
formed with the data packets of the first and the second time-adjusted streams would improve the 
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functionality for Nelson's system by allowing for simultaneous display of streams on the same screen as 
disclosed in the Mitsubishi reference. 

31. Claim 16-19 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nelson et al. 
(hereinafter Nelson) 4,598,397, in view of Anderson et al. (hereinafter Anderson), US 6,1 15,422. 

32. As per claim 16, Nelson does not teach the apparatus of claim 15, further including a controller in 
communication with the input interfece and the streaming media processor adapted for determining a 
variable transmission delay for the first and the second media streams based on a transmission time for a 
data packet of the first media stream and a time of receipt at the input interfece of the data packet and on a 
transmission time for a data packet of the second media stream and a time of receipt at the input interface 
of the data packet. 

33. Anderson teaches the apparatus of claim 15, further including a controller in communication with 
the input interface and the streaming media processor adapted for determining a variable transmission 
delay for the first and the second media streams based on a transmission time for a data packet of the first 
media stream and a time of receipt at the input interface of the data packet and on a transmission time for 
a data packet of the second media stream and a time of receipt at the input interfece of the data packet 
(Col. 13, Unes 57-62; Col. 2, lines 24-40; Col. 3, lines 33-35, lines 55-57; Col. 4, lines 26-28). 

34. It would have been obvious to one of ordinary skill in this art at the time of invention was made 
to combine the teaching of Nelson and Anderson because they both dealing with combine multiple 
streams into one stream based on a time synchronized fashion. Furthermore, the teaching of Anderson to 
allow a controller in communication with the input interfece and the streaming media processor adapted 
for determining a variable transmission delay for the first and the second media streams based on a 
transmission time for a data packet of the first media stream and a time of receipt at the input interface of 
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the data packet and on a transmission time for a data packet of the second media stream and a time of 
receipt at the input interfece of the data packet would improve the latency for Nelson's system by 
accelerate or decrease the rate of processing incoming signals based on amount of current delay in the 
system. 

35. As per claim 17, Nelson teaches the apparatus of claim 16, wherein the controller is further 
configured for adjusting the first intermediate format media stream based on the variable transmission 
delay of the first media stream and for adjusting the second intermediate format media stream based on 
the variable transmission delay of the second media stream to create a first and a second time-adjusted 
stream (Col. 10, line 67-Col. 11, line 10; Col. 10, lines 27-39). 

36. As per claim 18, Nelson teaches the apparatus of claim 17, wherein the processor combines the 
first and second time-adjusted stream to form the composite media stream with the first media stream data 
packet and the second media stream data packet being positioned for concurrent delivery (Col. 7, lines 5- 
13; Col. 5, lines 12-15, lines 49-54; Col. 9, lines 66-Col. 10, line 3). 

37. As per claim 19, Nelson teaches the apparatus of claim 17, wherein the time of receipt is 
determined based on a time reference signal received from an external timing reference (Col. 10, lines 1- 
3, lines 12-13, lines 23-24; Col. 12, Unes 26-29). 

Conclusion 

38. AppHcant*s remarks filed 10/01/2004 have been considered but are found not persuasive. 

39. In the remark, the Applicant argued in substance that Nelson feils to disclose or suggest 

"file that is being transferred, there is not indication that files can or would be useful before being entirely 
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downloaded, receiving party can begin to use the data before downloading an entire file". 

In response to Applicant's arguments that the references foil to show certain features of applicant's 

invention, it is noted that the features upon which applicant relies (i.e., file that is being transferred, there 

is not indication that files can or would be usefiil before being entirely downloaded, receiving party can 

begin to use the data before downloading an entire file) are not recited in the rejected claim(s). Although 

the claims are interpreted in light of the specification, limitations from the specification are not read into 

the claims. See/w re Van Geuns, 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). 

Furthermore, Nelson teaches of streaming media, see for example. Col. 3, lines 45-61, wherein the voice 

media is in the form of packets, and the packets can be used as soon as the conversation start during a 

voice session. 

40. In the remark, the Applicant argued in substance that Nelson foils to disclose or suggest 
"contemplating combining first and second media streams into a composite media stream" 

In response to Applicant's arguments, the media streams are combined into a single stream, sample 
section. Col. 5, lines 10-15, lines 57-60; Col. 6, lines 60-67, wherein the synchronous data and the 
asynchronous data are being combined into a single stream, this step is fiirther taught in details see for 
example. Fig 10(d), item 312 and 320, wherein the streams of data are combined using a multiplexsor 
item 318; see also. Col. 25, lines 40-50 for the teaching section, thus. Nelson teaches the above section. 

41 . In the remark, the Applicant argued in substance that Nelson foils to disclose or suggest 
"identification of steaming medias received, and an interfece for receiving said streaming media". 
In response to Applicant's arguments, the streaming of media comprises of asynchronous and 
synchronous data steams (Col. 5, hues 10-15), the interfoce would be item 1 1, Fig 2, wherein plurality of 
clear charmel devices 14 are attached in one embodiment, see for example, Col. 6, lines 60-65. 

42. In the remark, the Applicant argued in substance that Nelson foils to disclose or suggest 
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"first data buffer" 

In response to Applicant's arguments, the first data buffer was disclosed in Nelson, see for example, item 
312 in Fig 10. 

43. In the remark, the Applicant argued in substance that Nelson fails to disclose or suggest 
'transmission delays". 

In response to Applicant's arguments. Nelson teaches the transmission delay limitation, see for example. 
Col. 9, lines 24-26, Col. 13, lines 60-65, wherein the data is delayed prior to arriving at destination to 
allow proper synchronization. Fxuthermore, the controller 322 would determine the delay necessary, i.e. 
time in which the streams will be send out to the Multiplexsor and retrieve data firom the buffers based on 
such a delay, the delay is also controlled by the clock signal coming firom MUX 342. 

44. In the remark, the Applicant argued in substance that Nelson fails to disclose or suggest 
"streaming video". 

In response to Applicant's arguments. Nelson teaches of streaming video media, see for example. Col. 10, 
Unes 40-45, wherein the system is capable of using image data, it is known in the art that video is an 
animated series of images. Nelson's system can handle the image communications in the form of a 
video streams. 

45. In the remark, the Applicant argued in substance that Nelson feils to disclose or suggest 
"beginning and ending of multi-packet streams" 

In response to Applicant's arguments. Nelson teaches the above section, Nelson's system is synchronized, 
the multiplexed media steam when arriving at the destination will be resynchronized, thus timing 
information is a must; furthermore, see for example. Col. 1 1, lines 30-50 wherein the stop bit will 
describe an end of a packtized data stream. 
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46. In the remark, the Applicant argued in substance that Nelson foils to disclose or suggest 
"any packets from a first media stream are 'correlated' with any packets from a second media stream" 
In response to Applicant's arguments. Nelson teaches the above section. See for example, Col. 5, lines 
10-20, Col. 25, lines 45-50, wherein different formatted data are combined into a single composite stream. 

47. In the remark, the Applicant argued in substance that Nelson fails to disclose or suggest 
"CODECS use multiple different standards, there is no discussion of intermediate media stream" 

In response to Applicant's arguments, Nelson teaches the claimed section of claim 15, Nelson explicitly 
discloses that the composite streams can handle plurality of data formats, specifically, refer to Col. 25, 
lines 45-50; Col. 5, lines 12-20 for such details. The intermediate media streams are streams's condition 
prior to arriving at the MUX 318. 

48. In the remark, the Applicant argued in substance that Anderson fails to disclose or suggest 
claim 16, however, Applicant's arguments fail to comply with 37 CFR 1 . 1 1 1(b) because they amount to a 
general allegation that the claims define a patentable invention without specifically pointing out how the 
language of the claims patentably distinguishes them from the references. 

THIS ACTION IS MADE FINAL. Applicant is reined of the extension of time policy as set 
forth m 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 
1 .136(a) will be calculated from the mailing date of the advisory action. In no event, however 
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will the statutory period for reply expire later than SEX MONTHS from the mailing date of this 
final action. 

The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. The 
following patents and publications are cited to fiirther show the state of the art with respect to 
'Webcasting Method And System For Time Based Synchronization Of Multiple, Independent Media 


Streams". 



i. 

US 5596420 

Daum 

ii. 

US 4833673 

Chao et al. 

iii. 

US 6134379 

LaMacchia 

iv. 

US 4587651 

Nelson et al. 

V. 

US 5788812 

Krause et al. 

vi. 

US 5832085 

Inoue et al. 


Any inquiry concerning this communication or earher communications from the examiner should 
be directed to Chad Zhong whose telephone number is (571)272-3946. The examiner can normally be 
reached on M-F 7:15 to 4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
BURGESS, GLENTON B can be reached on (571)272-3949. The fex phone number for the organization 
where this appHcation or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent AppHcation 
Information Retrieval (PAIR) system. Status information for published appUcations may be obtained 
from either Private PAIR or Public PAIR. Status information for unpublished applications is available 
through Private PAIR only. For more information about the PAIR system, see http://pair- 
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direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 


CZ 

March 3, 2005 



DungC. Dinh 
Primary Examiner 


